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ABSTRACT 


Ever since the use of a vector performance-index in place 
of a scalar index in optimal control system problems was proposed 
by Zadeh in 1963, the idea has been under investigation. 

Reid and Citron in 1971 proposed a good technique in 
which the vector optimization is done by optimizing a scalar 
auxiliary index equal to the sum of the components of vector index 
weighted by constant coefficients; it has been pointed out by many 
authors that it is very difficult to choose weighting coefficients 
for a complex system. To overcome this difficulty, Salukvadze in 
the same year (1971) proposed an alternative technique in which 
a norm approximation to the utopian point, in the performance- 
index space, defined by the optimum values of various component 
indices is optimized; but the techniques for the optimization of 
a general norm approximation were not available until recently. 
Nandakumar in 1986 proposed a numerical algorithm to optimize a 
general norm approximation function by combining the concepts of 
Reid and Citron and Salukvadze. But Nandakumar did not study 
the various properties, particularly, convergence-related proper- 
ties, of his algorithm which are so important for computer imple- 
mentation of his algorithm. 

This thesis is a study of the various properties of 
Nandakumar* s algorithm from the point of view of computer imple- 
mentation of his algorithm. To ensure convergence of the algoritj 



a real sequence is proposed t’he • convergence properties of which 
are similar to those of Nandakumar*s algorithm. In the process, 
a computer program has been developed which implements Nandakumar* 
algorithm for a class of systems. 
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CHAPTER 1 


INTRODUCTION 


1*1 The Background 

Conventionally, control systems have been optimized using 
a single number calculable from the system characteristics, 
called -Uie scalar-valued performance-index, as a measure of 
the system performance. Problems arising out of the use of a 
single number as the performance-index have been pointed out 
ever since its inception (for control system problems) during 
World War II, but lacking a better alternative, it has been 
in widespread use. 

Use of a vector-valued performance-index as an alterna- 
tive to the scalar-valued performance-index in the problems of 
optimal control was suggested by Zadeh f 1 ] in 1963. Since the 
vector— valued performance-index optimization as a design 
approach is still an unfamiliar field to most people. Appendix 
A has been added to this thesis as a brief review of this 
field and to introduce much used terminology of the field. 

1 *2 The Problem 

A very general vector— valued performance— index optimiza- 
tion problem is now formulated for the sake of immediate 


discussion to follow. 



For 8 (HDe system S, the vector^valued performance-index 



is considered, where v is m-dimensional vector of system 
variables (i.e., v may be state-vector x(t), control vector 
u(t), or parameter vector 3 ), Also, there may be some const- 
raints imposed on v. 

The problem is to find out the "optimum* value of i(v), 
and the corresponding v. 


1.2.1 Remark 1 


Throughout “Uie rest of this thesis, the word “optirntmi* 
is used as synonymous with "minimum*. Case of maxisdzation is 
exactly similar except that the sign of the function to be 
optimized is to be reversed. 

1.2.2 Remark 2 


In what follows, the statements "system S is optimum" and 
"performance-index ^ is optimum" are treated as equivalent. 

1-3 Work of Reid and Citron [2] 

This work gives a technique to solve the problem defined 


in Section 1.2 



Since an n->dinensionaX perfoiraance-index jC is being 
considered and each component of is a real number^ ^ can be 
represented in an nodimensional vector space (performance-index 
space) defined over the field of real numbers Bl. It is 
assumed that all performance-indices ^ can be represented in 
the first orthant of this n-dimensional performance-index 

space (i.e*, each component of is positive); this can be 
ensured by changing the sign of those scalar perforroance-indice 
which have a negative sign. consists of two mutually 

exclusive regions t 

1. Admissible region 0. This corresponds to the performance- 
indices obtained by those system variables v vdiich satisfy 
the various constraints for the specific problaa. 

2. Inadmissible region 0 • 

Ctoviously, the search for non-inferior index vectors 
should be confined to 0. Also, origin can be safely excluded 
from 0 because this is an •optimal* point in IR and is a 
trivial case (and often unrealizable case, because the minimum 
value of an individual performance-index will normally be 
greater than zero). And the discussion of Reid and Citron 
does not apply to the case urtien origin is an "optimal" (also 
noninferior) point. 

On p. 16, Reid and Citron prove that for non-inferior 
vectors to exist , follovfing two conditions should hold. 

1. Region 0 should be at least partially closed, and 

noninferior solutions can exist only over this closed 
boundary of region 0 * 



2. Noninferior solutions can exist only on the lower boun- 
dary of region 0. 

Figure 1*1, curve (I) shows this for 2-diniensional case 
when whole of 0 is closed. 

Now a method to determine the lower boundary of admissible 
region 0, i.e., noninferior solutions, can be considered. 

Converting the noninferior index vector problem into a 
family of scalar index problems appears to be a good technique 
since the later type of problems are well studied by modem 
control theorists. Therefore, the auxiliary scalar index J 
is considered which is a function of the index vector j[. The 
index J will normally have one minimum value which will 
correspond to one point on the lower boundary of 0. So, to 
specify the whole of lower boundary, an n-dimensional vector 
parameter c is introduced and the scalar performance-index 
is defined as 

J = F(I, c) (1.1) 

which can be minimized for different values of c to obtain 
different noninferior solutions. 

What should be the form of c)7 The desired construe- 

tion of F(I^, c,) would be such t hat minimum value of J corres- 
ponds to the lower boundary points of 0 . 

"In general, it is difficult to find a functional form 
for . • J ". . . that will ensure a one-to-one correspondence 
between minimum points of . . .* J . . for a given value 
of . . c ". . . and noninferior points on ..." the lower 





Fig, l.ti Illuitration of that Moion of parfomaiica*lfid#x spac< 
whera noninfarior aelutiont can axiat* 
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boundary of "Therefore, consider now a limited class of 
problems . • for which this correst>Qndence holds true > 

"This form is the standard linear sum of scalar indices 
weighted by constant coefficients given as • * .» [2 , pp. 

16-19] . 

^ * <c, I> ; > 0; i * 1, 2,...,n (U2) 

Then Reid and Citron give a geometrical proof that Ea» 
(l»2) indeed gives the lower boundary of i bv minimizing J for 
various values of c so long as the shape of lower boundary is 
such that 181 correspondence between minimum points of J and 
values of jc hold . Implicit in this geometric proof is the 
assertion that 1*1 correspondence between values of c and 
minimum points of J *= <£, I> holds true if following two 
conditions are satisfied. 

1. Noninferior index surface is monotonically varying with 
respect to each scalar index 

2. If the equation of noninferior index surface is given 

in terms of various I^» i * 1, 2, ..^yn, then first 
partial derivatives i 2,...,n-1, are 

also monotonically varying. 

Implication of this is that the results of Reid and Citron 
cannot give all the noninferior solutions when noninferior 
index surface is like the lower boundary of Figure 1.1, curve 
Cl), but can give all the solutions when the lower boundary is 
like the noninferior index surface of Figure 1.1, curve (II). 




In the case of Figure 1*1, curve (I), only that portion ©f 
noninferior index surface will be obtained by this method 
vdiere this correspondence holds true, i.e. parts AB and CD. 

1 .4 Work of Salukvadze [3. 4] 

To use Reid and Citron's [2l technique, £ is to be chosen 
before the solution is attempted. This is an especially 
difficult task for large systems, as noted by Salukvadze [3 3 
and Nandakumar[5] . To overcome this difficulty, Salukvadze 
gives another technique to solve vector optimization problem. 

Let each component of ^ be iiinimized separately. Let the 
minimum value of be I = 1» 2,...,n. Ideally, one wants 

~ * ^^10 ^20 • • • solution, but this is not 

possible in majority of practical cases since, in most cases, 
same v will not minimize more than one comp>onent of I. So, 
the point 



in performance-index space is the ideal point one is striving 

of 

for, but cannot get it because^the very choice of various 
mutually conflicting criteria in vector p>erformance-index I_; 
point ^ is called (by Salukvadze) the "utopian pKjint". 

Since the utopian point cannot be reached, one can think 
of going closest to it. So an approximation function 
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(approximation to point RC^) « R(l,(x)) is introduced. 

Minimum value of R(^) will give corresponding v as the •optimum* 
solution in R(l)-sense. Moreover, approximation function R(^) 
may be any scalar positive definite function of Once a 
specific R(I) has been selected, the definition of the type of 
compromise one is looking for is fixed . 

As a useful approximation function R(l), Salukvadze 
considers the Euclidian norm squared: 

R(I) = = S (I^ - (1.4) 

- - 1 10 

when all components of i are normalized, i.e., reduced to 
dimensionless form. If it is not so, then 


R(I) = r ( -i- , — 3 l O .) (1.5) 

i=1 io 

can be considered* 

Subsequently, more general norm functions as approximation 
functions were considered* According to llandakinaar [s] , p. 6, 
following generalized norm was first introduced by Yu: 

n 1 1/P 

R(I) = [ E (Ij - (1*6) 

i=1 

where p is a positive integer. 

Its counterpart according to Eq. (l*5) when various conpo- 
nents of I. are not reduced to dimensionless form can easily be 
written as 


R(I) 




P 1/p 
) ] 


(1.7) 
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In Eqs. (1.6) and (t*7), selection of a specific p means 
the definition of compromise has been specified. 

By minimizing any R out of Eqs. Cl. 4) to (1.7), a mini- 
mizing ▼ is obtained. With the selection of this • • some 

deterioration takes place in each quality indicator . . .• 

•. . .of the system (compared to what we would have obtained 
by optimization of only that particular indicator)^ however, 
this deterioration is uniform with respect to the entire 
collection of indicators . . •■ ". . . and is minimal 

possible#* [4 , pp. 1170-1171|. 

1 *5 Work of Nandaktmarfs] 

Literature before the work of Nandakumardo not provide a 
suitable approach to solve the vector optimization problem 
using Eq. (l.6) for p > 2; even for p = 2, Salukvadze*s [3] 
approach is quite involved. Nandakumar has given a numerical 
algorithm to solve the problem; he has also indicated a way 
to choose a specific compromise solution, i.e., a specific p, 
for a given system. 

1.5.1 Minimization of the Performance- Index Given by Eq. (1*6) 
For a Caiven p ‘ 

Performance-index given by Eq. (1.6) is rewritten as 
follows: 

J *= [ £ * p = 1,2,...,a> (1.8) 

i=1 



where ^io is the ainimum value of 

This equation gives a noninferior solution, for a given p, 
on the lower boundary of the admissible region 0 of perfor- 
mance-index space [3]. 

Another way of finding the lower boundary of the admiss- 
ible region 0 of performance-index space is to minimize 

j ss <c, I> * r C.I.; c. > Oj i = 1, 2,..*,n {l«^) 

i=1 ^ ^ ^ 

Eq. (1.9) is easy to minimize but it is very difficult to 
choose c for a practical system. Eq* (I.8), on the other hand, 
is difficult to minimize but is free from the problems associ- 
ated with choosing c. Nandakumar has given an iterative 
algorithm to minimize Eq* (l*8) by reducing Eq* (1.8) to take 
the form of Eq. (l*9). 

Minimization of Eq. (1*8) is equivalent to minimizing 


J 


n 

2 

i=1 


<h - ^io^ 


( 1 . 10 ) 


In Eq* (1.10), put 


= ^^i-^io^^^' i = 1, 2,.*.,n (1.11) 


So, Eq. (1.10) can be '.'written as 


J 


n 

2 

i-1 


H 




n 

2 

i=1 


Cili - 


n 

2 

i=1 


c.I 


i^io 


( 1 . 12 ) 


Since is the minimum value of c^ given by Eq* (I.II) 
is always positive* So, minimization of Eq. (I.IO) is equivalent 
to minimization of Eq. (1*9) subject to Eq. (1 .II), because 
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tk 


if c* is treated as constant, then £ in Eq. (l.12) 

i«1 ^ 

becomes constant* 

So, the minimization of Ea. (l*8). which is the goal of 
Nandaknmar*s thesis, is equivalent to minimization of Eg. (l*9) 
subject to Cj ^ defined by Eq* (l*1l) > A way of achieving this 
is an iterative algorithm in which one starts with an assumed 
£ and minimizes Eq* (l*9) independent of Eq* (1*11); 1 obtained 
by this minimization is used to calculate new c, using Eq* (l*1l)* 
Then one checks if assumed c is equal to calculated £*=£,'; . 

if yes, then the problem is solved; if no, then modify the 
assumed c for next iteration by equation 


Cf = c-^ + s . (c^ - c^)5 i = 1, 2, ...,n 


(1.13) 


where s is a suitably chosen step- size. 

And this is repeated till convergence. 

Nandakumar also says (without giving any reasons) on 
p. 16 of his thesis that it •* . . is convenient to normalize 
the weighting constants . . c^ such that 

£ c. = 1 ; c. > 0 • (1 .14) 

i=1 


which means the iterative algorithm, instead of calculating 
c from Eq* (l*11), should, use the following equation for the 
purposes 


^i 


n .. . ,P-1 


1 = 1,2 


, • • • , 


jasj 


(Ij - l3o> 


n (1.15) 


This raethod will work (provided the solution exists), 
theoretically, for all finite p. 

Nandakumar has given the above procedure to calculate 
solution for finite. p in the fona of a step—by— step procedure* 
In Figure 1.2, Nandakumar’ s algorithm is written as a flow- 
chart which is exactly equivalent to his written statements, 
except one difference ; while Nandakumar has indicated the 
system variables (control vector u, or parameters) with respect 
to which the minimization is to be carried out, these have not 
been indicated in Figure 1.2j this does not make any difference 
if it is kept in mind that minimization can only be carried 
out with respect to certain system variables, v in the context 
of this thesis. 

Nandakumar has shown on p. 13 of his thesis that for 
p « 00 , the solution of Eq. (1.8) has the property that 

= constant; is=1,2,...,n (1.16) 

1.5.2 Selection of a Specific Compromise Solution 

Now that a set of compromise solutions .corresponding to 
different values of p have been obtained, a specific solution 
is to be selected. 

Many authors have suggested various criteria to select a 
specific solution [1, 2], none of which appears to be of 
universal application. Nandakumar offers yet another approach 
to do this job. 




Fig. 1.2s Flos^-chart equivalent of Nandakumar* s algoritha for 











Since every p i« associated with a specific compromise 
solution I *= , based on specific system 

requirements the designer can fix the value of one of the n 
scalar indices? Nandakumar calls this the "reference index". 

This fixes p and, consequently, -Uie solution vector I. So, 
the job is done. 

1 .6 Cfclective of This Thesis 

Nandakumar' s [5 3 thesis gives an algorithm to compute 
the various compromise solutions of a general vector-optimira- 
tion problem and a method to choose one compromise solution 
out of the set of cmupromise solutions computed by the 
algorithm. Simplicity of this algorithm to tackle difficult 
problems is its beauty. 

But Nandakumar did not attempt a comprehensive study of 
the various properties of his algorithm such as, when the 
algorithm converges to a solution, on which parameters of his 
algorithm the convergence property depends, how the rate of 
convergence can be accelerated, etc. 

The aim of this thesis is to study the .properties of 
Nandakumar* s algorithm and to develop a computer program which 
implements Nandakuaar’ s algorithm for a class of vector- 
optimization problems. Out of the various properties studied, 
convergence property is given special emphasis because of its 
extreme importance in computer implementation of the algorithm. 
A real sequence whose convergence properties are similar to the 
convergence properties of Nandakwaar’t algorithm has been 
proposed to ensure convergence of Nandakumar’ s algorithm. 



Organization of This Thesis 


Chapter 2 is a theoretical probe into the various properties 
of Nandakuaar* s algorithm from the point of view of computer 
implementation. Chapter 3 discusses the computational problems 
and how the study of Chapter 2 has been used in the computer 
program developed. Chapter 4 is the concluding chapter which 
suggests a few areas of further work on the subject. 



CHAPTER 2 


ANALYSIS OF NANDAKIWAR' S ALGORITtW 

2.1 Introdgction 

Before saying anything about the implementation problems, 
it will be good to state the assumptions about the class of 
problems to which Nandakumar* s algorithm is applicable; these 
were not stated by Nandakumar but they are important for the 
results of Reid and Citron [2] to be valid and were assumed by 
Reid and Citron, as discussed in Section 1.3. 

1. It is assumed that Ij^(v), i = 1, 2,...,n, are positive. 

2. Noninferior index surface is monotonically varying with 
respect to each I^ , i = 1, 2, ...,n. 

3. If the equation of noninferior index surface is given as 
a function of the various Ij^, i * 1, 2, .••,«, then the 
first partial derivatives ai_/3l. , i = 1, 2,...,n, are 
also monotonically varying. 

There is no simple way of ensuring that assumptions 2 
and 3 hold for a specific problem, as implied by Reid and 
Citron [2]; probably some heuristic considerations can help. 

Also, implicit in the use of Eq. (1.6) by Nandakumar 
to find noninferior solutions is another assumption, as 
indicated by Salukvadze [3, 4] but not mentioned by Nandakumar. 

4. All components of ^ are reduced to dimensionless fora. 

If this is not so, then Eq. (l»7) instead of Eq. (1.6) 


should be used 



Now follows «n analysis of the reasons why c was nomalo 
ized by Nandakumar in the sense that 

n 

S c. «= 1, (2.1 > 

is=1 ^ 

and of the conditions that can ensure the convergence of 
Nandakumar’ s algorithm to a solution* 

2.2 Normalization of c 

Nandakumar [b] has mentioned on p. 16 of his thesis that 
it is **. • • convenient to normalize the weighting constants . . 
Cj^ in the sense of Eq. (2.1). The reason this normalization 
approach is convenient can be seen from the following discussion. 

If assumed c^^ in the beginning of an iteration of 
Nandakumar* s algorithm and c^ = (I^ - calculated at the 

end of this iteration differ by orders of magnitude, some 
iterations are needed to make the orders of magnitude of c^ and 
c| conform. Only then the convergence point where 

c * c’ (2*2) 

can be approached. This is because of the following reasons. 
Since c^^, i = 1, 2,...,n are all positive, one can write 

n n n c^ 

J ^ £ c* I* = ( Z c^ ) . [ E (-;— — * li ) ] 

1=1 ^ ‘ 1=1 ^ 1=1 EC. 

3-1 ^ 

(2.3) 

Solution I which minimizes Eq. (2.3) is the same as that 


which minimizes 



J *: 


iB 


n 

£ 

i=1 


( 




n 


J 



n 

because S is a constant. This means, I which minimizes 
i*1 ^ 

n 

r c. .Ij depends on the relative values of c. , i = 1, 2, ...jn. 
i=1 

Experience of various tests on computer has shown that the 
process of making the orders of magnitude of Cj^ and c^ conform 
does little about adjusting the relative values of various 
components of c^ to that of final solution} these iterations of 
Kandakumar* s algorithm are almost wasted. In some tests with 
a simple second order linear system with 2-dimensional I, 

CPU time thus wasted was found to be approximately equal to the 
time it takes to solve the problem with normalized 

Normalized was also found useful in developing conver- 
gence criteria for Nandakumar's algorithm, as will become 
apparent in next two sections. 


2.3 Definition of the Point of Convergence 

Nandakimiar* s [5] definition of the point where we say 
that the algorithm has converged, Eq. (2.2), is to be modified 
to suit ccMiiputer implementation needs because nothing is exact 
on computer. 

For a precise mathematical definition suitable for 
computer implementation, a clue is suggested by Kreyszig t6l, 
pp. 650-651, during a discussion of infinite sequences. Rele- 


ion is quoted below. 



"If to each positive number n there is assigned a number 

then these numbers 
n ’ 

are said to form an infinite sequence or, briefly, a sequence , 

and the numbers z_ are called the terms of the sequence. 

n ■' 

A sequence whose terms are real is called a real 
sequence." 

•A sequence , z^, ... is said to converge ... if there 
is a number c with the following property. For every positive 
real e (no matter how small but not zero) we can find an 
integer N such that 

I Zj^ - c I < € for all n > N. 

c is called the limit of the sequence." 

This suggests that if an appropriate real number could 
be associated with iteration of Nandakumar’ s algorithm 
such that the convergence properties of the real sequence 
a\ a^, .•.,a'^,... are similar to the convergence properties 
of Nandakumar* s algorithm, then the definition of the point of 
convergence of Nandakumar* s algorithm could have been borrowed 
from Kreyszig Eb]. 

The ultimate aim of making c = c* suggests two ways to 
construct such a sequence: 

a^ ^ flc-c’H} jssi, 2,... 

If algorithm converges, limit of this sequence should be 


zero. 



2U 

For computer implementation, Nandakumar* s algorithm can 
be considered to have converged v^en 

a^ « 1 1 c - c * 1 1 ^ e 

2. A set of n secpiences, which are to converge simultaneously, 
is formed by defining 

aj i rc^ - c| I; i = 1, 2,...,n; j = 1, 2,... (2.4) 

If algorithm converges, the limit of each such sequence 
shall be zero. 

For computer implementation, Nandakuraar’ s algorithm can 
be considered to have converged when 

a^ = I c^ “ c*^ I ^ » i = 1,2,...,n (2.5) 

This second definition will be used in this thesis. 

2.4 Conditions for Convergence 

In Nandakumar's algorithm, if the point of convergence 
is not reached, we need modify c^ for next iteration by 

c. = c* + s • (d — Cj); i = 1» 2,...,n (2.6) 
and go for next iteration. 

Since the algorithm is general, possibility of knowing 
the analytical relationships between v and the various perfor- 
mance-indices is ruled out. So an analysis of Nandakumar's 
algorithm to know whether the algorithm converges before it 
is actually used cannot be done; only numerical methods are 


feasible. 



The numerically feasible test that was found suitable 
for implennentation is stated as a theorem by Kreyszi^ [6}, 
p* 661, in the following words: 

"If a real sequence is bounded and monotone, it 
converges.* 

1 2 

That the sequence a^, a^,... is bounded (see Footnote 1) 
can be seen from the definition of a^, Eq. (2.4), because both 
and c| are between zero and one so that aj| is finite. 

Since the limit of the sequence a^, a^,... is zero and, 
in general, the algorithm is started with a finite a^, it is to 
be ensured that the sequence is monotonically decreasing, i.e., 

1 2 

a^ ^ a^ ^ ... 

1 2 

To ensure that the sequence a^, a^,... is monotonically 
decreasing, it is assumed that c^^ versus c| curve is monotone, 

as shown in Figure 2.1, curves (l) and (ll) (see Footnote 2). 

1 2 

That now monotonicity of the sequence a^, a^,... is assured 
can be explained as follows. 

In curve (l) of Figure 2.1,. points A and B mark the 
extreme values of c^ and c^, and point C is .the actual solution. 

^ "A sequence z^, Z 2 f* said to be bounded . if there 
is a positive number K such that ... 

I Zjj I < K for all n.* - Kreyszig [6], p. 653. 

In all examples given by Nandakumar [5] except one 
(Example 6.2), and in both examples given in this thesis, 
curve (I) holds. In one example in Nandakumar* s thesis for 
which 1 was 3-dimensional, curve (l) holds for two values of i 
and curve (ll) holds for one i. All of the testings for this 
thesis were confined to curve (l). 



It is assmed that tha itaratloas are started at point 
where ^ cj* 

Algorithm to generate for next iteration can be 
designed to ensure that the relations 



hold. 

If Eg. (2.4) is used to form the sequence, then monoto- 
nically decreasing sequence may involve oscillation of points 
Dj, j =2, 3,... about solution point C. It appears intui- 
tively more appealing if D. could be made to steadily approach 
point C, without oscillating about the solution point. This 
can be assured if the definition of Eq. (2.4) is modified as 
follows: 

*i ® ■" i « 1, 2,...,n; j * 1, 2, ... (2.7) 

Ways of ensuring the assumption of Figure 2.1 before 
Nandakumar* s algorithm is run are not known, but the practical 
feasibility of this assumption was brought out by the fact 
that for all examples for which Nandakumar' s algorithm was run, 
this* assumption was valid (see Footnote 2). 

So, the conclusions are: 

1. It is to be ensured that the magnitude of a^ calculated 

by Eq. (2.7) monotonically decreases in successive itera- 
tions and that the sign of a^ does not change in successive 
iterations. (Since the limit of a| is zero, a change in 
its sign means the point of convergence has been bypassed). 



This will ensure that Nandakianar* s algorithm is steadily 
converging to a solution. How this will be ensured will 
be discussed in Chapter 3. 

It is to be considered that the algorithm has converged 
when conditions dictated by Eq. (2*5) are satisfied. 



CHAPTER 3 


IMPLEMENTATION OF NANDAKUMAR’S ALGORITHM 

3. 1 Outline 

Section 3.2 discusses the computational difficulties from 
the point of view of Nandakimar’s general algorithm. Section 3.3 
gives the details of the FORTRAN program developed to implement 
Nandakumar’ s algorithm. Examples are given in Section 3.4. 

3.2 On General Aig^rithiB 

Discussions in this section have reference to Nandakumar* s 
algorithm as given in Fig^^^ 1 *2. 

The minimum infoimaii®** needed to run the algorithm are 
1* m, the dimension of 2L* 

2. n, the dimension of i* 

3. p. Nandakumar has written the algorithm in a form in 
which it can be Txin for all finite 'p* in a single run. 
Discussion to follow removes this outer p-loop; this 
does not make any difference to computational problems 
of the algorithm. 

4. vector performance-index I(v). This information is 
supplied by providing a subroutine that will return Ij^(v) 
once V and i are given. 

5. constraints on v. implementation scheme, this 

information is providing a subroutine which 

can check if a given v satisfies the constraints. 
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With this information, it is possible to minimize 

n ^ 

i * 1, 2,...,n as well as J(v) » 2 c, .!.(▼)• 

i*1 ^ ^ “ 

Now the computational problems of Nandakumar* s algorithm 
are taken up on block-by-block basis as per'Figure 1.2* 

3.2.1 Block 5 

Algorithm can only be started with an initial value of c. 
Keeping in mind the normalization constraint imposed by 
Eq. ( 2 . 1 ) on £, and a complete ignorance as to what c should 
be to solve the problem at hand, it appears most obvious to 
choose (and that this choice is good enough was brought out by 
various tests on computer) initial c such that all of its 
components are equal, i.e.. 



because £ is n-dimensional. 

3.2.2 Blocks 6 and 15 

In Figure 1.2, iteration number is not being used for any 
purpose. Well, in this type of iterative algorithm, solution 
shall be obtained, in general, after infinite iterations. 

Since this is impractical, an upper limit is to be imposed on 
the ntunber of iterations to be executed in the worst case. 
Within a given nuaiber of iterations one should get the solution 
with reasonable accuracy. If this does not happen, one of 
the many possible actions can be to restart the algorithm with 
the value of c obtained at the end of the given number of 
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iterations if tlia algorithm is found converging till this 
point*. In this thesis, if maximum allowable number of itera- 
tions are exceeded, algorithm is declared *not converging” 
and appropriate final data (c, c* , I, etc.) are printed out. 

3.2*3 Block 10 

Convergence of the algorithm to a solution for a given p 
is tested here, as discussed in Section 2.3, by Eq. (2.5) but 
in a bit modified form as follows: 

ICj - c[\ 

^ < aj i = 1, 2,...,n, (3.2) 

where a is a real positive number less than one. 

Need for this form was felt during actual implementation. 
a - 0.02 was found useful and has been implemented. 

Since both c and c* are normalized, their comparison can 
be made by testing only (n-l) corresponding components instead 
of testing all the components; but in this thesis, all the n 
components are compared because the CPU time saved on this 
count is very small. 

3.2.4 Blocks 7 and 14 

If, for a specific iteration j, the algorithm does not 
pass the test of block tO, c is to be modified for next itera- 
tion in block 14; and what this modified c will be depends upon 
the step-size *s*. Whether, for a specific iteration, the 
algorittiB passes the test of block 10 depends on c chosen for 
this iteration. So, step-size *s* is to be carefully chosen. 
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According to the discussion of Section 2.4, Nandakumar* s 
algoritiw will be steadily converging to a solution provided 
that the magnitude of a^ calculated by Eg. (2.7) is monotoni- 
cally decreasing in successive iterations and that the sign of 
a| does not change in successive iterations. So, the algo- 
rithm for step-size s should ensure that the sign of a^ 
does not change in successive iterations and the absolute 
value of a^ does not increase in successive iterations. 

An iteration for which a|, j >2, does not violate these two 
conditions is termed •successful", else it is declared 
"unsuccessful"; in either case, step-size s should be 
changed, directly or indirectly (see Footnote 3). In the 
implementation for this thesis, block 7 which initializes 's* 
was removed and a block just before block 14 was added to 
generate *s’ by the algorithm on next page. 


Indirectly changing ' s* means c for next iteration is 
changed by some means other than changing *s' explicitly. 
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ALGORITm TO GENERATE STEP^SIZE » «» 


START 

If iteration number j « 1, then 

declare the iteration “successful" . 
initialize step- size s » 0.5. 

•• ® J J * 1# 2, »*.,n. 

else 

aj = c^ - c^^; j =1, 2,...,n. 

aj-”* 

If bj = ■ > 1 for all j « 1, 2, ...^n, then 

®i 

declare the iteration “successful*, 
s •- (s X 1.2). 
else 

declare the iteration "unsuccessful". 

RETURN 


Once an iteration is declared "unsuccessful", the proper 

c for 

c certainly lies between^^this "unsuccessful" iteration and the 
previous "successful" iteration. Fastest rate of convergence 
was obtained by making the c for next iteration equal to the 
average of c for the most recent "successful" and "unsuccessful" 
iterations; direct change of *s’ is not needed now. This has 
been implemented. 
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Also, it was found that sometimes, particularly for values 
of p ^ 5, a gives an a^ « (c| - c*^) > 0 and for next 

iteration which differs from c| by 0,0005 gives an < 0. 

In such cases, accurate to three decimal places was 
declared the final solution even though the conditions of 
Eg, (3,2) were not satisfied. The reason was traced down to 
the flatness of c^^ versus c| curve; two approximate plots for 
a second order system with 2-dimensional ^ to be taken up as 
Example 2 in Section 3,4 are shown in Figure 3»1, 

Also, an output block missing in Figure 1.2 is to be 
added • 


3*3 Details of the Program Developed 

A computer program has been developed which implements 
Nandakumar' s algorithm. In view of the limited time available 
and extreme generality of Nandakumar* s algorithm, the program 
developed is applicable only to a subset of the problems to 
which Nandakumar* s general algorithm is applicable. Specifi- 
cally, the problems for which this program is applicable are 
the following limited class of problems s 

* 

1. System S being considered is time-invarient. 

2. Behaviour of the system can be completely characterized 

by a set of *m* free parameters C ®ach 

of vrtiich is a real number (see Footnote 4). This free 


^ Actually will be, more often, a coefficient - i.e., 
a function of system parameters. But throughout this thesis, 
this will be called a parameter. 


»1 
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pdrBiit6t»6r S6t shall be written as the paranneter vector 

[ 

<l2 

a *= . 

Sn 

.. 


3. The parameter vector a defines a vector-space. Because 
of physical limitations, a cannot assume an arbitrary 
value. This thesis assumes that a is constrained to lie 
in region Q of parameter- space (see Footnote 5). 

All testings for this thesis have been done for this 
limited class of systems. 

Actual implementation required a subroutine to minimize 
a scalar function of n-variables subject to general 
constraints. This subroutine named MINIM in the program of 
this thesis uses Pattern-Search Algorithm (Appendix B) which 
is simple, sufficiently effective and easy to implement on 
computer. 

Nandakumar* s algoritlM yields a compromise solution in 
the sense that it tries to minimize 

j(a) = [ E (ii(3) - lio)”]’''’’ . 
i=1 


^ This region Q may be characterized by a set of equality 
and inequality constraints on the elements of a or functions 
thereof, or may be characterized otherwise. 
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the solution vector ^ of wrtiich is an approximation to the 
utopian point I® . But as discussed by Salukvadze [3, 43, 
this could have been just any positive definite approximation 
to _I • Program of this thesis has been written in such a way 
that can be any arbitrary function for which the solution 
exists. So J(3,) can assume any form which can be reduced to 

n 

is=1 

All that is to be done for this is to replace that routine 

which calculates c by appropriate routine; this subroutine 

n 

should, however, ensure that E Cj = 1 • 

i=1 ^ 

Also, function minimization routine MINIM requires a 
o 

starting 2 = 2* To start Nandakumar* s algorithm's iterative 
loop, a suitable ^ was found to be the average of various ^ 
which minimize different performance-indices individually in 
block 3, Figure 1.2. 

Keeping in mind the discussions of this thesis, flow-chart 
of Figure 1.2 is modified in Figure 3.2. Program of this 
thesis is an implementation of the flow-chart of Figure 3.2. 

3.4 Examples 

Using the program developed, two examples have been 

worked out. Each of these examples uses a 2-dimensional I'. 

/ 

The first example was solved by Nandakumar, so results 
can be compared. The second example uses two well studied 
criteria for parameter optimization as the elements of the 


vector criterion 



Read n, m, p, 3 


lu / , lU 

/■'•i a 


Miniij^ze 1^(0); i = i,2,..:7ifr 
Q G Q. Put this minimum equal 
“to and minimizing 2 = 5^ 


2 2 
o i=l 

a — 


\c^ = 1/nj i = 
Iteration number = 1 


It 

Minimize J(2) = 2 . 1^(2)? 

i=1 

2 Q- Let the minimzing 
values of various performance- 
indices be IiminJl=1 ,2, ...,n. 


an estimate of 2 
that minimizes 
1^(2) alone. 


} Both these block 
Yfill use the 
I User-written 
I subroutines 
I (i) to calculate 
-•1 ^i^a) given 

* a» i*®! » 2 » • • * 

I and 

i ,(ii ) to test if 

II 2 ^ Q‘ 


Increment 
iteration 
number by 1 


Generate c 
for next 
iteration . 


^i - n » _ 

^Has algorithm converged?^ 


I If c’ is to be 
[generated by a 
[different formul 
the formula of 
•this block is to 
j be replaced by 
^appropriate form 


'Iteration number = Maximum number 
,of iterations allowed? 


5 

Yes 

r 

Take appropriate action. 




/Output the 
/ relevant 
'information. 


STOP) • 


STOP. 


Fig. 3.2t Modified Nandakumar* s algorithm 
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3.4.1 Example 1 

This was considered by Nandakumar [5], pp. 76-86. System 
considered had the transfer function 

“ ^'4 2 &S + 1' ’ y(o) ■= 0 , u(t) = 0. 

Two-dimensional vector performance— index considered was 




CD 0 

/ e^(t) dt 


0 



TO ^ 

/ (0.25 e^(t) + u^(t)) dt 

N. - 


0 


where e(t) = Y(t) - u(t). 

Since ^ is to be optimized with respect to 6 , it was 
expressed as follows: 


I, (6) 



IgCS) 


0.256 + 

- 




Optimal values of the individual performance-indices were 
calculated analytically by Nandakumar as follows: 

- 1.000, 6 = 0.5 

I^Q = 0.559, 6 = 1.118 

This information was fed to the program developed in this 
thesis with 6 6 [0.4, 1.3]. The results are shown in 
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Table 3.1. Sine* the ease of p = 1 is trivial, this was not 
calculated. 


Table 3.1 


Compromise Solutions for Example 1 Calculated by the Program 

Developed in This Thesis 


o 

Utopian Point j I ' 


1.000 

0.559 


p 

*=1 

^2 


^2 

6 

2 

0.451 

0.549 

1.055 

0.623 

0.695 

3 

0.446 

0.554 

1.056 

0.622 

0.698 

4 

0.442 

0.557 

1.057 

0.621 

0.700 

5 

0.438 

0.562 

1.058 

0,621 

0.702 


Results computed by the program developed (Table 3.1) 
compare well with the results obtained by Nandakumar (Table 3.2). 

Most of the differences between the results of Table 3.1 
and Table 3.2 can be attributed to the fact that while 
Nandakumar minimized J(6 ) = c^I.j(6)+ analytically, 

the program of this thesis does so numerically. 

Figure 3.3 is a plot of versus I2. It can be seen 
that the compromise solutions exist only on the lower boundary 
of the admissible region 0 of the performance-index space, i.e., 
between points A and B. 






Table 3.2 


Comproaiae Solutions for Example 1 Computed by Nandakumar [b] 

t .000 


Utopian Point, 


0.559 


p 

<^1 


^2 


^2 

6 

2 

0# 454 


0.546 

1.054 

0.624 

0.694 

3 

0.445 


0.555 

1.056 

. 0.622 

0.699 

4 

0.441 


0.559 

1.057 

0.621 

0.700 

5 

0.439 


0.562 

1.058 

0.621 

0.702 

3.4.2 

Example 2 






The system considered is 

its transfer function 

the second 

order system given by 



iL 

s) , 

1 





or 


s^ + 26 s + 

1 


with 

time 

zero initial 

t - 0. 

conditions 

and a unit- 

step input applied at 


This system will be considered because its behaviour is 


well understood. 

The two-dimensional performance-index to be considered is 




OO o 

/ e^(t) dt 



l2(^) 

1 ^ 


/ t . 1e(t) 1 . dt 
o 


1 ( 6 ) 



where e(t) » y(t) - «(t). 

The two criteria are not mnttially conflicting, except 
between A and B, i.e*, on the lower boundary, as shown in 
Figure 3*4. 

The results using the program developed in this thesis are 
shown in Table 3.3j in this example, all minimizations inclu- 
ding individual minimizations were done numerically on 
computer. 


Table 3. 3 

Compromise Solutions for Example 2 Computed by the Program 

Developed in This Thesis 



Utopian 

Point, I® 

1 

1.000 

1.952 


p 


®2 



^2 

6 

2 

0.700 

0.300 

1 .062 

1.977 

0.709 

3 

0.748 

0.252 

1.058 

1.985 

0.702 

4 

0.766 

0.234 

1.054 

1.999 

0.693 

5 

0.766 

0.234 

1 .053 

1.999 

0.693 


Graham and Lathrop [?] tried to show that 

00 

lAb ) = / t . Ie(t) I . dt 

^ o 
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is superior to 

1^(6) s: e^(t) . dt 

o 

in so far as the transient response is concerned* Since 
compromise solutions lie between A and B in Figure 3.4, a more 
flexible choice of parameter 6 is obtained with 2-di«ensional 
performance-index as compared to using only one index; this 
point was noted by Nandakumar [5 3» 



CHAPTER 4 


C0NCLUSIC3NS 


The various properties of Nandakumar' s algorithn 
necessary to develop a computer program have been studied with 
particular attention to the convergence property. In view of 
the limited time available, the program developed is applicable 
only to a relatively small subclass of problems to which 
hjandakuoitar* s algorithm is applicable. 

The sequence proposed to ensure convergence of Nandakumar’ 
algorithm has been successfully tested. 

Further work on the subject can be done by developing a 
very general computer program that can handle all types of 
problems to which Nandakumar* s algorithm is applicable with 
appropriate additions. 

There is also scope for further work on parameter optimi- 
zation on the lines of Graham and Lathrop [7]. In [7], for 
single-input- single-output linear systems with zero initial 
conditions, standard forms of transfer functions (i.e., 

standard values of the parameters of the system) have to be 

00 

developed to minimize / t . fe(t)| • dt. It is possible to 

o 

identify the various performance-indices of importance in mode 
multi-input-multi-output systems and form vector performance- 
indices using various combinations of these -scalar indices to 
develop standard designs. 



APPQ4DIX A 

VECTOR- VALUED PERFORMANCE— li^Dgxt A QUALITATIVE REVIEW 
A.1 Conventional Approach 

To start with, a very brief review of the familiar topic 
of 'Optiwal Systems* follows. 

G.W, Leibniz coined the word "optimum** during a philoso- 
phical discussion to conclude that our universe is "the best 
(optimum)" among all possibXe universes (see Footnote 6 ). 

Today wej, the control engineers, use the word "optimum" in 
very much the same sense of Leibniz, albeit in a general way by 
using it in both "the best" and "the worst" sense, depending 
upon the problem. 

Of course, man’s desire for perfection ("optimization") is 
much older than the time of Leibniz. To cite but only one 
example, many • ancient cities are in fact circular, 

probably to minimize the lengths of city walls needed to enclose 
the city's fixed area" [8 , p, 3 ], most such ancient 

optimizations are based on intuition which will most often fail 
in complex problems. So we, the control engineers, are more 


^ Leibniz invented the word "optimum" in his book (publi- 
shed in 1710) "Theodicy s Essays on the Goodness of God, the 
Freedom of Man, and the Origin of Evil" (translated by 
E.M. Huggard, and translated edition published by Yale 
University Press, New Haven, 1952 (p, 128)), according to [8 , 
pp. 4 and 93 . 



eoncem«d with quantitative analysis (instead of intuitive 
approach) which is relatively easy to use and is more reliable 
in extremely complex systems. 

For a quantitative study of optimal control systems, 
three well— recognized steps are usually employed by modem 
optimal control system theorists* 

1 ■ Getting the information about the system, accurately and 
quantitatively, as to how the system variables interact. 
This often involves developing a suitable, often much 
too simplified, mathematical model of the system involving 
system variables. 

2. Deciding on how to measure system performance quantita- 
tively in terms of system variables. This almost always 
means deciding a single number, called performance-index, 
the value of which is accepted as the quantitative measure 
of system performance. Performance-index should, of 
course, be a function of those system variables (may be 
functions of time) the values of which can be altered to 
get better performance out of the system. 

3. Changing the relevant system variables such that the 
performance-index is optimized. 

In each of the three steps just described, the constraints 
on system variables (which are almost always imposed in some 
sense) should be borne in mind. 



A.2 More On Perfoimance-Indieca 


Three steps in optimization problem have just been 
described. Step 1 requires considerable effort for complex 
systems and is certainly a difficult problem; techniques that 
can reduce this effort or increase its accuracy are most welcome, 
but this is not the problem of interest in this thesis. Many 
efficient algorithms to implement step 3 (optimization, i.e., 
minimization or maximization) are known when performance-index 
® s3.ngle number, as is the case just considered. For the 
time being, however, only step 2, finding a measure of system 
effectiveness, shall be addressed. 

•Optimization is decisive because it narrows down the 
possible choices to one - the best one* [ 8 , p. 3 ]. How 
heavy the dependence of the decisiveness of optimization is on 
the performance-index chosen cannot be overemphasized. So 
more realistic a performance-index for a given system, more 
accurate and realistic the results. 

So a considerable research effort has been spent on what 
a performance-index should be for a specific system (or more 
often, for a class of systems), since the use of performance- 
index was introduced in control systems by Norbert Wiener during 
World War II. So, from the simplest performance-indices chosen 
earlier for single-input- single-output systems, refinements 
were made (and are still being made) on the performance-index, 
many times making it more complicated and moie realistic but 
with more requirements on computational effort and new tech- 
niques for its computation. 



Design of a specific perfoimance-index, in general, 
requires 

(i) identification of desired system characteristics. 

(ii) finding a numerical measure to measure each of 
these characteristics. This numerical measure 
should be calculable from the numerical values of 
those system variables with respect to which the 
system is to be optimized. 

(iii) giving appropriate weightage to different charac- 
teristics of the system to find out a single number 
obtainable from numerical measures of various 
systea characteristics. This final nuisber, the 
performance-index, is therefore calculable from 
those system variables subject to which the optimi- 
zation is to be carried out. 

Stability (and how stable a system is), sensitivity, 
accuracy, transient response, resonance characteristics, band- 
width, size, weight, power consumption and economics are amongst 
the numerous characteristics desired from a control system [9 , 
pp. 75-77, 79, 89, 101-102; 10 , p. 3]. However, the importance 

accorded to specific characteristics varies from system to 
system [9 , pp. 75, 79], the overall goal in most physical 
systems being profit, cost or efficiency [8 , p. 3]. 

Designing a suitable performance-index means measuring 
quantitatively the various characteristics and giving them 
appropriate weightage; in many systems, this may be extremely 
difficult [8 , p. 3]. So, most of the older literature on this 



subject considers e single-input- single— output systen ¥rith 
perfoimance-index foimed by functionals (of varying complexity) 
of system error with the conditions that the system be stable 
and physically realizable* A review of many important criteria 
of this type can be found in '^[7 ; 9 , Chapter 4; 10 , 

Chapter l3>it can be seen from this literature that as the 
I^rformance-index is made more and more realistic, it gets 
more and more complicated* Many performance-indices have been 
suggested during recent years for modem complex multi-input- 
multi-output systems to make them more and more accurate* But 
complicacy of the practical systems renders the job difficult. 

A* 3 Need for Vector-Valued Performance-Index 


A few problems of scalar performance-index have been 
noted in Section A* 2* There are more problems with a scalar 
performance-index; let us note the views of a few authorities 
on the subject, 

1* "One of the most serious weaknesses of the current 

theories of optimal control is that they are predicated 
on the assumption that the performance of the system 
can be measured with a single number ,*.* 

The trouble with this concept of optimality is that, in 
general, there is more than one consideration that 
enters into the assessment of performance of *.*• the 
system •..* and in most cases, these considerations cannot 
be stbsulmed under a single scalar-valued criterion. In 
such cases, the system S may be superior to the system 
S* in some respects and inferior to S' in others ...*• 

[1 , p* 59], 

■Classical control theory, which uses transform methods 
to solve systems of linear equations with constant 
coefficients, handles multicriteria problems in an 
implicit manner* The various performance-indices to be 
considered in a classical problem are merely evaluated 
directly at each step of the trial-and-error design of a 
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suitable control system* Modem or optimal control theory 
is superior to the classical method because the optimal 
control method is capable of handling more general types 
of nonlinear and linear control systems. Optimal control 
theory also provides a means of optimizing a performance 
criterion whereas the classical theory offers only a 
trial-and-error scheme for selecting a linear system to 
satisfy the predetermined performance restrictions. 

However, the use of scalar performance-index in the 
formulation of the optimal control problem has tended to 
obscure the traditionally multidimensional character of 
the performance measure.** [ 2 , p. 26]. 

3. **... disadvantage in ...* optimal system design with a 

scalar performance-index "... approach comes from the 
fact that performance of the system must be represented 
mathematically by a single scalar-valued performance-index. 
Since there are usually many requirements that enter into 
the judgement of system performance, the choice of a 
single index to represent one or more of these requirements 
is necessarily arbitrary or subjective. Unless the 
trade-offs achievable between various competing require- 
ments are well understood, there is little objective basis 
for specifying "Uie performance-index ...." [11 , p. 469j. 

4. "... control irules that are well defined through condi- 
tions of optimizing a single criterion leads to the 
followings The selection and optimization of a given 
functional answers to only one of the requirements of the 
control system, while other requirements, which are often 
equally important are ignored. The totality of all 
requirements may be accounted for by a collection of 
functionals forming a vector of criterion functions, l.e., 
a vector— valued criterion." [3 , p* IX, Introduction J* 

5. "Even when the type of ..." system performance "... measure 
is clear, it is not always easy to express its quantitative 
dependence on system variables." [ 8 , p. 3J. 

In such cases, it may be easier to express quantitative 
performance measure as a vector instead of scalar. 

All these quotations underline the importance of using a 

vector— valued performance— index in optimal control theory 

instead of a scalar performance-index. 


A. 4 Peculiarities of Vector-Valued Performance-Indices 


Discussion of this and the next section will be with 
respect to the problem defined in Section 1.2, Chapter 1. 



Following notes pinpoint the basic differences between 
scalar and vector performance-index optimization. They also 
offer a general outline of the characteristics of vector 
performance-indices. 

A. 4.1 Note 1 

•In the case of scalar performance- index, one is interested 
in a point on the real number line that represents the optimum 
index value, and v "... that corresponds to this index. 

The extension of this investigation to the case of a vector 
performance-index naturally leads to the determination of an 
optimum index surface and the corresponding ..." v in an 
n-dimensional performance-index space. "The index surface to be 
determined represents the end points of index vectors from 
which the control designer can make his final selection." [2,p. 1‘ 

These statements stem from the fact that no two vector 
performance-indices can be compared the way scalar performance- 
indices are compared to give a unique optimum solution. To 
define the above-mentioned surface of^ptimud!‘vector performance- 
indices, a^ptimml'vector performance- index will have to be 
defined; so the definitions of Note 2. 

A.4.2 Note 2 

When working with vector performance-indices, the difference 
is usually made between "noninferior* and "optimal" systems or 
performance-indices. In the context of this thesis, a performan< 
index l(v) will be considered "optimum" if all of its comp>onents 



ar» ■inimizad ti«ultan®ously (by a single v). And a ptrfoi»ance- 
index ^{v) will be considered "noninferiox" if there i$ no 
performance-index whose every component is less than the cories- 
pondiag component of l(v). 

A*4*3 Note 3 

It is clear from Note 2 that the "optimum index surface* 
of Note 1 is the set of non-inferior systems. In this context, 
following quotation is of interest: 

"Usually, the designer will have enough physical intuition 
concerning the problem to decide whether or not an optimal 
solution exists. If, for example, he considers a simple rocket 
problem, he can intuitively recognize fuel consumption and 
kinetic energy as comparable performance-indices. It is when 
criteria are found to be conflicting, either by intuitive 
reasoning or by trial-and-error, that the concept of a non-inferioa 
set becomes important" [2, pp. 15-16]. 

The curious point is: if various performance-indices are 
compatible, it is as good to minimize one as to find the 
optimum vector. It is only when one is searching for a system 
subject to many conflicting criteria (which is most often the 
case) that vector optimization theory has the greatest role to 
play. 

A. 4.4 Note 4 

Whether one is working with a scalar performance— index ox 
' a vector performance-index, the ultimate goal is a single solu- 
tion as the system to be implemented. So, in vector optimiza- 
tion, a single point for ultimate design from the noninferior 
"index surface" of Note 1 is to be selected. 

Going through literature, it is found that virtually every 
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author suggests his own criterion. For example, Zadeh [1 ] 
suggests that a scalar performance-index should be introduced 
over the set of non-inferior systems to make the ultimate 
choice. Reid and Citron [2] offer a more original approach: 
"sidbjectively" select the desired system from the set of non- 
inferior systems because when subjective criteria are 

concerned (e.g., safety versus profit) ...* this *•... method 
of attack seems more plausible, because it leaves the subjec- 
tive questions to be answered by subjective methods ....• It 
appears that although we should strive for different algorithmis 
or criteria to select a single system out of the set of non- 
inferior systems, ultimate choice of how a system will be 
selected should be left to the designer; a universally applicable 
standard method appears a difficult- to- realize dream. 

A.5 Present Information About the Subject 

Although the *•.. first formulation of a problem of 
optimizing vector— valued criteria was given in 1896 »..• by 
■... economist Pareto it was only in 1963 when Zadeh 

published his article [l] •... which first presented the ques- 
tion of designing control systems which are optimal relative to 
several performance-indices." [3, p. ll* So, the study of 
optimal control systems with vector criteria is relatively new. 

The "... goal of L.A. Zadeh* s paper, in addition to its 
initiatives, is to show that in a majority of practical cases, 
exact optimization of a vector functional is unattainable 
This means that if ay"... is chosen to optimize one scalar 



functioaal, then almost always it is not possible to optimize 
a second scalar fmnctional tasing the same ...* v. This means 
that the problem of optimizing all scalar criteria with 

the same ...» v »... is impossible and to give it a precise 
mathematical formulation is also impossible ....» [3, p. 1l]. 

At present, the question of existence of noninferior 
solutions under vector-valued performance-index is well settled 
[3, pp. 2, 20-23, Chapter 3? 5, p. 2]. 

Following is a 't>rief qualitative survey of the various 
approaches being used in solving vector optimization problems; 
a much more detailed survey can be found in [3, Chapter l]* 

Various methods proposed for the solution of vector-valued 
performance-index optimization can be classified into the 
following groups [s, p. 2; 3, p. slj 

1 • (^timization of an hierarchical sequence of performance- 
indices is based upon the idea »... of a preference 
ordering of the given criteria ....» Although a great 
improvement upon conventional single scalar-valued 
performance-index optimization techniques, this method 
does not realize the full potential of vector-valued 
performance-index optimization »•.. since optimization 
with respect to the first, most important criterion 
already leads to a unique optimal solution and everything 
is reduced to optimization only relative to the first 
criterion ....» [3, p. 4]. This thesis does not use this 


me thod 



2. The sethod of deteiml nation of a set of noninferior points 
is the most vastly explored one, ttie idea of which was 
first given by Zadeh [1]. 

A landmark in this technique is the paper by Reid and 
Citron [2], discussed in Section 1.3, Chapter 1. 

3. The methods for determining a solution based on some foim 
of compromise are in existence for some time. Many forms 
of compromises have been proposed. For example, Borisov’s 
principle of equitable compromise is "... based upon the 
idea that the relative decrease in the value of one or 
several criteria should not exceed the relative increase 
in the rasaining criteria.* [3, p. ?]. 

Another compromise approach is the ^method of constraints* 
in which "... one starts with a solution relative to 
which it is necessary to impose constraints on particular 
criteria which must be satisfied in the first place. On 
the basis of this information, a revised solution is 
affected." [3, p. 93. 

One of the most important ideas of compromise solutions 
is due to Salukvadze [3, 4] discussed in Section 1.4, 
Oiapter 1. 



APPENDIX B 


PATTERN SEARCH ALGORITHyi TO MINIMIZE A 
FUNCTION OF n VARIABLES 

Reference: fS. pp, 307-3101 

This is a direct climbing type of technique. Algorithm 

is based on the hopeful conjecture that any ... adjustment 
of independent variables, which have been successful during 
early experiments, will be worth trying again." 

•Although the method starts cautiously with short excur- 
sions from the starting point, the steps grow with repeated 
success. Subsequent failure indicates that shorter steps are 
in order, and if a change in direction is required, the tech- 
nique will start over again with a new pattern. In the vicinity 
of the ..." bottom "... the steps become very small to avoid 
overlooking any promising direction." 

Algorithm is as follows. 

Suppose we want to minimize yCjf). where x is n-dimensional. 
Illustrations of the method will be for 2-dimensional x 
(Figure B1 ). 

Searth of j~ iteration is started at a point (called 
"temporary head") t^ , with a step-size 6. for i^ variable. 

Let be the vector vdiose i— component is 6^ and the rest of 
components are zero. We perturb the i~ variable x^ about the 
point t. . , (starting from x, ) and find a new temporary head 
tjj^ such that 
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“j i-1 * o'therwise 

• 



When all variables have been perturbed, the "base point" 
for next iteration is defined by 

-j+1 ' -j,n 

Let the base point for j — iteration was b . • Starting 
temporary head ^ for next iteration is found by joining 

bj'and by a straight line and doubling it in the same 

direction, i.e. by 

“j+1,0 “ -j ^ • ^-j+1 ’ ^j^ 

y^ij+1 0^ ^ (j+1 iteration is started as 

before* If it is not so, is obviously the minimum point 

till now; and no similar search pattern can be continued. The 
idea then is to start anew from point as new base point 

bj_j ,2 starting temporary head o ” — j+2» with shorter 

steps. The process is continued till the step-size becomes so 
small that required accuracy is assured. 

The algorithm is started with an initial base point b^ 
(which may be arbitrarily chosen), with t^^ = b-j • 
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